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Abstract -Recommender systems recommend objects regardless of potential adverse effects of 
their overcrowding. We address this shortcoming by introducing crowd-avoiding recommendation 
where each object can be shared by only a limited number of users or where object utility dimin- 
ishes with the number of users sharing it. We use real data to show that contrary to expectations, 
the introduction of these constraints enhances recommendation accuracy and diversity even in sys- 
tems where overcrowding is not detrimental. The observed accuracy improvements are explained 
in terms of removing potential bias of the recommendation method. We finally propose a way to 
model artificial socio-economic systems with crowd avoidance and obtain first analytical results. 
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Introduction. — Recommender systems are a pow- 
erful tool which nowadays helps most online retailers to 
make effective offers to their consumers. They use past 
user preferences to recommend new objects that the users 
might like. Research of recommendation grows rapidly 
and tackles issues like recommendation algorithms [UH], 
' recommendation in social systems [3] , and the use of rec- 
ommendation in e-commerce [3]. 

While there are situations where an arbitrary number 
of users can be recommended the same object, in other 
situations this is not the case. For example, one cannot 
recommend the same restaurant to many people as it has 
limited space and service capabilities. Similarly, it is not 
advantageous to use data on industrial production in coun- 
tries [5]-[7] and recommend the same new product to many 
countries as it could lead to undue competition and a poor 
ultimate outcome. 

We propose crowd-avoiding recommendation which ad- 
dresses this issue by imposing a strict occupancy con- 
straint on individual objects or by assuming that object 
utility decays with the number of users sharing it. Our 
approach is linked to physics where particles occupy the 
energetically most favorable states but are either allowed 
in single occupation (fermions) or obey no restrictions 
(bosons). Although for particles there are no other op- 
tions, we are here interested also in situations lying be- 



tween these two extremes where an object can be rec- 
ommended to an intermediate number of users. There is 
also a close connection with the combinatorial assignment 
problem where agents (users) can perform certain tasks 
(objects) with a certain cost and one searches for a bijec- 
tive agent-task matching that minimizes the sum of the 
corresponding costs |S]. We use here some of the algo- 
rithms originally developed for the assignment problem. 

Note that crowd avoidance is a general concept which 
can be used also in situations where resources can be 
shared by an arbitrary number of parties and user sat- 
isfaction does not decay with the number of other users 
sharing the resource. Given a set of user score (or cost) 
values, one can always apply an occupancy constraint or 
penalty and see how this impacts the assignment of ob- 
jects to users. It is of particular importance to note that 
this new assignment is bound to be more diverse than the 
original one where no additional constraints were present. 
For example, if an individual object scores top for many 
users, it cannot be assigned to all of them if the occupancy 
constraint is sufficiently strong. Other objects then have 
to replace it and the composition of the assigned objects 
becomes more diverse. In this way, the crowd avoidance 
concept can help address one of the long standing chal- 
lenges of information filtering: the lack of diversity [9] and 
its potential adverse impact on network topologies |10) . 
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In this letter, we study crowd avoidance and its effects 
in various socio-economic systems. We begin by defin- 
ing possible approaches to introduce crowd avoidance in 
recommendation. We illustrate the use of this concept 
on empirical DVD renting data. Although one does not 
expect overcrowding to be a problem there, we show that 
including crowd avoidance in the recommendation process 
can increase the accuracy of the recommendation. To ex- 
plain this unexpected observation, we use simple artificial 
data produced by a biased recommendation method and 
show that crowd-avoiding recommendation effectively re- 
moves this bias and thus increases recommendation accu- 
racy. Finally we propose how to model artificial systems 
with crowd avoidance and suggest an analytical approach 
that can be used to study them. 

Framework. — We consider a set of U users (which 
can be real persons but also firms or countries) and a set of 
O objects (which can be restaurants, hotels, or sectors of 
industrial production) . We then suppose that appreciation 
of object a by user i is encoded in a single-valued utility 
Ui a (the higher the better) . One can consider an idealized 
case where the true utility values are known or a case 
where some other information is used as a proxy for the 
utility. For example, recommendation scores obtained by 
a recommendation algorithm can serve this purpose — we 
shall study this in detail in the following section. 

Our goal now is to model a system where for some reason 
it is not convenient for too many users to share the same 
object and thus some "repulsion" of users is in action. 
Reasons for this repulsion may vary and we shall discuss 
some of them in detail later on. Two approaches are at 
hand to model user repulsion. The first one (which we will 
refer to as "effective utility") postulates an effective user 
utility that decreases with the number of users n a sharing 
object a. One of the possible forms for the effective utility 
is 

u ia {n a ) = u ia /n b a (1) 

where the exponent b determines the repulsion strength^ 
When 6 = 0, repulsion is absent and if all users prefer one 
single object, they are all free to herd on it. When b — > oo, 
repulsion is extremely strong and utility-maximizing users 
prefer objects with the lowest occupancy over objects sat- 
isfying best their personal preferences. One can say that 
these two cases represent a bosonic and fcrmionic limit, 
respectively. The second approach (which we will refer to 
as 'constrained occupancy') postulates a rigid constraint 
n a < m implying that each object can be shared by at 
most m users. In terms of effective utility, this is equiva- 
lent to 



Given user preferences (represented by utility values Ui a 
and by how this utility diminishes with object occupancies 

1 Other forms of effective utility, such as Ui a (n a ) = Ui a — bn a , 
are possible but we do not consider them here. 



n a ), the natural next step is to find the best assignment of 
objects to users. Here the two important approaches are 
user-centered optimization where users attempt to maxi- 
mize their own ui a and global optimization where the sum 
of all effective utility values is maximized. User-centered 
optima can be obtained by a simple process where users 
arrive consecutively and choose their most preferred object 
(MPO) or by a more complicated process where users are 
allowed to change their choice until no one has an incen- 
tive to change and a Nash equilibrium is reached. These 
two processes have their real motivations: one might be 
tempted to leave a suddenly overcrowded bar for another 
one (corresponding to the Nash equilibrium case) but if 
one has already booked a good seat in a theater, there 
is no reason to care how many people did their bookings 
after (corresponding to the MPO case). Since multiple so- 
lutions can be found in all three optimization approaches 
(due to the degeneracy of both the global optimum and 
Nash equilibrium and due to the dependency of MPO on 
the users' order of arrival), all results presented here are 
averaged over several independent realizations. 

Although constrained occupancy and effective utility 
have many features in common, they allow to view the 
problem from slightly different angles. The former ap- 
proach has an analog in the classical assignment problem 
where one wishes to find an optimal user-objects assign- 
ment with respect to a global energy function [8j. Fast 
algorithms exist to find global optima in this case and 
study their relation with user-centered optimization [TTj . 
Tools from spin glass theory are also of use here [T2lfT3] 
(in our case, however, the true glassy phase is absent as 
the number of local minima grows only polynomially, not 
exponentially with system size). The effective utility ap- 
proach instead allows, as we shall see later, for simpler 
analytical treatment. 

Evidence from empirical data. We now demon- 
strate the concept of crowd avoidance on empirical 
DVD rental data released for the NetflixPrize (see 
www . netf lixprize . com) from which we randomly choose 
2, 000 users who rated at least 100 objects in the origi- 
nal data and 2, 000 objects rated by at least 10, 000 users 
in the original data. The resulting set contains 592, 995 
evaluations in the integer rating scale from 1 to 5. For the 
purpose of recommendation with unary data (i.e., without 
ratings) , ratings 3 or more are interpreted as favorable and 
constitute 515, 342 user-object links in the unary data set. 
Note that for the present case of users renting DVDs, the 
concept of crowd avoidance is relevant more for its ability 
to diversify the recommended content than for some real 
decline of utility when many users share a DVD (although 
a limited number of physical DVD copies might impact 
users by creating waiting times for popular objects). 

The usual way to evaluate a recommender system is to 
move 10% of the data to a so-called probe set and then use 
the remaining 90% of the data (a so-called training set) to 
recover the missing (but known) probe part [5] . We use a 
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variant of a popular and high-performing recommendation 
method Singular Value Decomposition (SVD) Q31[T5] f° r 
data with ratings and the Probability Spreading method 
(ProbS) [Tni[T7] for data without ratings. In both cases, 
the training set is used to obtain estimated ratings or rec- 
ommendation scores u ia (the higher the better) for all 
user-object pairs. Ultimately, a ranked list of objects is 
created for each user i where rank of object a is Ti a - In 
traditional recommendation, top T objects from a user's 
recommendation list are "recommended" . One then eval- 
uates performance of the recommendations by comparing 
these top T objects with user-object pairs in the probe — 
the more of them appear among the objects recommended 
to the given user, the better. The usual corresponding 
metric is called precision and it is defined as the ratio of 
recommended probe objects to the total number of recom- 
mended objects TU. Note that the standard procedure of 
creating the probe by random selection of links results in 
popular objects being over-represented in the probe. This 
favors the ProbS method which is popularity-biased and 
disadvantages the SVD method. As a result, SVD under- 
performs ProbS despite the former using more information 
(i.e., the ratings) and thus being generally more reliable. 
Since our focus here does not lie in a direct comparison 
of these two methods, this aspect is not essential for our 
analysis. 

To evaluate the diversity of recommended objects, we 
use their effective number 
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where n a is the number of users who get recommended 
object a. When all objects are recommend equally of- 
ten, n a = TU jO and n c s = O; when the same object is 
recommended to all users, n e g = 1. 

To study the effect of crowd avoidance we turn Ui a into 
Uia(n a ) and use the two above-described approaches (con- 
strained occupancy and effective utility) to obtain a new 
set of recommendation lists. Since the number of evalu- 
ated top objects T is found to be of little importance in 
our tests, we set T = 1 for simplicity (thus, only one ob- 
ject is recommended to each user). The simplest approach 
to select the recommended objects is based on local opti- 
mization: users arrive in random order and choose their 
most preferred object (MPO), that is the one with the 
highest present effective utility. Since the outcome de- 
pends on the order of arrival of users, we always average 
our results over 1 , 000 independent realizations of this pro- 
cess. It is straightforward to generalize this approach to 
a Nash equilibrium framework where user preferences are 
evaluated repeatedly and users are allowed to switch to 
another object which they prefer more than their origi- 
nally selected object. Finally, it is also possible to con- 
sider global optimization where a global quantity, in our 
case the total effective utility, is maximized. Finding a 
globally optimal assignment of objects to users is a daunt- 
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Fig. 1: Recommendation precision vs maximal occupancy m: 
black and red lines denote results for data with ratings (SVD 
recommendation) and data without ratings (ProbS recommen- 
dation), respectively. The solid and dashed lines denote re- 
sults for MPO and global optimization, respectively. The inset 
shows precision vs 1/6 with the solid and dashed lines repre- 
senting MPO and Nash equilibrium, respectively. 



ing task but fortunately, effective algorithms exist for the 
case of constrained occupancy. We use the classical Hun- 
garian algorithm |llj which, due to memory constraints, 
allows us to study the system for the occupancy constraint 
m < 12. Due to excessive computational complexity of the 
problem, we do not consider global optimization for Ui a 
given by Eq. (fTJ). 

The resulting precision dependencies are shown in 
Fig. [1] When m ~ U or b w 0, the allowed occupancy 
is enough to accommodate all users or repulsion is weak 
and results are thus identical with the assignment of the 
object with the highest Ui a to each user. When m = 1 
or b — > oo (the fcrmionic limit), one is forced to assign 
much inferior objects to some users and the recommen- 
dation precision suffers. However, the course of precision 
is not monotonous: when some intermediate occupancy 
constraint is applied, precision can be improved and this 
improvement is further magnified if a sophisticated opti- 
mization scheme (Nash/global) is used. 

Fig. [2Jt,b show the effective number of objects recom- 
mended to users, n c g , which grows with repulsion strength 
as expected. At m = 14 which maximizes the preci- 
sion value P(m) for SVD recommendation, the observed 
n e ff f=a 155 is significantly higher than n e ff « 11 achieved 
when the occupancy constraint is missing. We can thus 
conclude that the artificial occupancy constraint allows us 
to simultaneously improve precision and diversity of rec- 
ommendation lists. Furthermore, one can easily show that 
the observed precision improvement is not just an artifact 
of using recommendation methods which do not put best 
objects to the top of their recommendation lists. Fig. [2fc 
shows precision P{r) when objects ranked r are recom- 
mended to each user without any regards to occupancy 
and repulsion and demonstrates that the further down the 
recommendation list we go, the lower the achieved preci- 
sion. Why then crowd avoidance helps? 
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rank r rank r 

Fig. 2: Panels (a) and (b) show the effective number of recom- 
mended objects vs maximal occupancy and 1/b, respectively. 
Panels (c) and (d) show the average recommendation precision 
and the average object degree vs object rank in the recommen- 
dation lists, respectively. Red lines refer to results obtained by 
ProbS and black lines refer to those obtained by SVD. 
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Fig. 3: Results as in Fig.[T]for the artificial data described in the 
text with and without the popularity bias. The probe object 
occurrence probability decay as: Q(r) — p(l)[l — lnr-/lnr max ] 
(solid lines, Q(r) = for r > r max ), Q(r) = [p(l) - ei]/r + ei 
(dashed lines), and Q(r) — [p(l) — £2] e 1_r + £2 (dotted lines) 
where p(l) = 0.25. Parameters r max , ei, and £2 are set in 
order to have an average of 10 probe objects for each user, i.e., 
X/ Q( r ) — 10- With bias, P(m) shows a maximum at m < U 
in all three cases. 



When sufficiently strong occupancy restriction is ap- 
plied, one is forced to move in recommendation lists of 
some users from the top rank 1 to a lower rank r. This 
move does not influence the precision if the top-ranked ob- 
ject and the newly selected object are both probe or both 
non-probe. Therefore to observe a precision improvement, 
the probability of exchanging a non-probe object at rank 
1 for a probe object at rank r must be greater than the 
probability of exchanging a probe object at rank 1 for 
a non-probe object at rank r. Such a situation can oc- 
cur if the used recommendation method is biased in some 
way and, along with successful recommendations demon- 
strated by Fig. [2t, places some wrong objects at the top of 
many users' recommendation lists. For example, Fig. [2ji 
shows that ProbS is strongly biased towards popular ob- 
jects that tend to end up at the top of recommendation 
lists (at the same time, SVD is not popularity biased or it 
is even weakly biased in the opposite direction). 

The question still remains of how such advantageous 
channeling and recommendation bias arise. To approach 
it, we construct a set of artificial recommendation lists 
producing the same phenomenon. Each artificial object 
is assigned a random hidden variable h a which encodes a 
particular characteristic of the object (popularity or some- 
thing less tangible) to which a recommendation method 
can be sensitive and biased. For example, the general 
bias of recommender systems towards popular objects is 
well known and represents one of open problems in this 
field [TTIHB] . A recommendation list for a given user con- 
tains a small number of probe objects which are chosen 
from all objects at random and the rest are non-probe ob- 
jects. The ranking of all objects is then constructed from 
top to bottom by applying two simple rules: (i) With prob- 
ability Q(r), a probe object is chosen at random from the 
remaining probe objects and placed at rank r; Here Q(r) 



is a monotonically decreasing function of rank r; (ii) In the 
opposite case, a non-probe object is chosen from the re- 
maining non-probe objects with probability proportional 
to h a . In effect, the first rule states that the recommen- 
dation method used to build the lists works well and puts 
probe objects preferentially at the top of recommendation 
lists. The second rule implies that errors of the recom- 
mendation method are biased by the hidden variable h a . 
To check whether the second assumption is necessary, we 
also present results for the case where non-probe objects 
are chosen purely at random. 

Artificial datasets were created for 2, 000 users and 
2, 000 objects as in our real data. h a values were drawn 
from the standard log-normal distribution with mean 
and sigma 1. We then run MPO for artificial datasets and 
average over multiple realizations of recommendation lists 
and the order of arrival of users. Fig. [3] shows that when 
bias is present, constrained occupancy can enhance the 
recommendation precision. The shape and magnitude of 
this enhancement depends on Q(r) (note that in particu- 
lar the logarithmically-decaying Q(r) is supported by how 
recommendation precision decays when only objects of a 
particular ranking r arc chosen — this is shown as p(r) in 
Fig. and on the distribution of h a (the narrower the 
distribution, the weaker the bias and the smaller the possi- 
ble gain due to constrained occupancy). When the bias is 
removed entirely, no precision improvements can be seen 
and P(m) grows monotonically with m (i.e., the weaker 
the occupancy constraint, the higher the precision). Simi- 
larly, if the choice of both probe and non-probe objects is 
subject to the same bias, precision improvement vanishes 
too (the two groups of objects then essentially merge). If 
probe and non-probe objects are subject to different kinds 
of bias, precision improvement can be still achieved. 

To summarize, we found that if a recommendation al- 



p-4 



Crowd Avoidance and Diversity in Socio-Economic Systems and Recommendation 



gorithm has some bias, then introducing user repulsion or 
constrained occupancy not only helps to increase the di- 
versity of recommendations but it may also enhance their 
precision. This enhancement can be substantial if the ac- 
tual bias disagrees with preferences of the users but it can 
also vanish if the two are in line {e.g., if an algorithm is bi- 
ased towards popular objects and the users want popular 
objects). Note that we studied data where no real prefer- 
ence for low object occupancy is expected. In the opposite 
case, one could expect even stronger positive effects from 
introducing crowd avoidance. 

One can generalize Eq. |(3J) to a heterogeneous occu- 
pancy constraint by imposing n a < m a . For example, one 
can set m a = Ck l a where k a is popularity (degree) of ob- 
ject a in the input data, exponent / determines the level 
of heterogeneity, and C allows for fixing the average max- 
imum occupancy at a given value m. I = corresponds 
to the already discussed case where all m a = m. Prelimi- 
nary results for the SVD method show that with I > it 
is possible to further magnify the precision improvement 
to a level similar to that of ProbS (that is, precision values 
around 0.25). This is in line with the previous observation 
that SVD suffers of the way the probe set is selected. If 
popular objects can be shared by more users than unpop- 
ular ones (i.e., when I > 0), they are more likely to be 
recommended and thus the precision can be further im- 
proved. For the ProbS method, we observe no substantial 
precision improvement for I =/= 0. 

Analysis of artificial data. — In addition to the de- 
scribed practical applications, a complementary view can 
be obtained by studying artificial systems where crowd 
avoidance plays a role. To do that, we replace empirical 
user preferences with artificial correlated utility values 

u la — Vl - cx ta + \fcq a (4) 

where q a represents the intrinsic quality of object a, Xi a 
quantifies the individual preferences of user i for object a, 
and c£ [0,1] determines the magnitude of user- user cor- 
relations. Elements Xi a and q a are drawn independently 
from the standard normal distribution Af(0, 1) and thus 
the distribution of u ia is also A/"(0, 1) independently of 
the value of c. The Pearson correlation of scores given to 
an object by two different users is C(i,j) = c. We focus 
here on the case represented by Eq. (([1])) where the effec- 
tive utility gradually decreases with the number of users 
sharing an object. Note that the term n~ b in u,i a affects 
only the magnitude not the sign of the effective utility. 
Objects that have negative score u ia for a given user are 
therefore bound not to be chosen by this user regardless 
of their occupancy and occupancy of the other objects. 

The first step is to compute the resulting object degree 
distribution f(n a ) for different levels of correlation and 
values of the repulsion strength. The relation between ob- 
ject utility Ui a and degree n a is particularly simple when 
user correlation is perfect and thus u; Q = q a . In the case of 
user-centered optimization (MPO/Nash), users gradually 
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Fig. 4: Degree distribution for three values of the repulsion 
parameter b: b — 0.5 (red squares), b = 0.25 (orange crosses). 
b — 0.1 (blue circles). Dashed black lines correspond to Eq. (0 
(values of F are respectively 2.5, 3.0 and 4.5). The simulation 
parameters are c = 0.5, U = 5 • 10 5 and O = 10 3 ; (n) = U/O. 

arrive and select the object with the currently highest ef- 
fective utility. This flattens the effective utility landscape 
and the effective utility q a /n a is thus constant across all 
objects in the limit of a large number of users, imply- 
ing q a = A(n a / (n)) b where A is determined by requiring 
^ a u a = U (each user selects one object). When user 
preferences are not perfectly correlated, a similar process 
takes place but the situation is more complicated. When 
a user selects an object, not only the intrinsic quality q a 
but also the individual user preferences Xi a matter. One 
can illustrate their effect on an example of an object with 
q a = which is obviously chosen by no user when c = 1. 
When c < 1, positive Xi a terms make effective utility of 
this object positive for some users and n a > 0. This leads 
us to a generalized dependency between q a and n a which 
has the form q a + F = A(n a / (n)) b where F reflects fluctu- 
ations of Ui a around q a and A again makes it possible to 
achieve ^ Q n a = U. Since the distribution of q a is known, 
this relation directly leads to the degree distribution 

bAS-i ( (Av h — F) 2 \ 

/(y) = V2*(i- C ) ^l~~2(r^H (5) 

where v := n/(n) = nU/O. One can approximate F by 
extreme statistics for a normally distributed variable |19j 
or by relating it to the fluctuation magnitude occurring 
with the probability 1/U (thus for one user on average). 
Since these approximations arc too crude to produce good 
fits of the data, we choose F by hand instead and then 
adjust A accordingly. Fig. |4] shows good agreement be- 
tween this semi-analytical result and degree distributions 
following from numerical MPO matching in a system with 
1, 000 objects, 500, 000 users, and c = 0.5. 

Discussion. — Although recommending the same ob- 
ject to too many users can have adverse effects in many 
real situations, this letter is to our best knowledge the 
first attempt to introduce and study crowd-avoidance in 
recommender systems. We showed that applying object 
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occupancy constraints or user repulsion to results of an or- 
dinary recommendation method can be beneficial in two 
complementary ways. Firstly, it naturally increases the 
diversity of the recommended content and thus helps to 
address one of the long standing issues in information fil- 
tering [T7]. Recommendation diversity is further closely 
connected to sustainability of information filtering tools 
which emerges as an important challenge [10]. Secondly, 
crowd avoidance can improve accuracy of the resulting 
recommendations — despite the fact that herding of users 
does not reduces their benefits in the studied DVD rental 
data. The practical problem of choosing a well-performing 
constraint can be solved by parameter fine-tuning on a 
given data (by hiding 10% of the data in the same way as 
we did here) or by applying some simple rules of thumb 
which are yet to be found. 

It is rare that introducing constraints to an optimiza- 
tion problem can improve quality of the solution. We pro- 
posed a simple explanation for the unexpected accuracy 
improvement observed in our case which is based on cor- 
recting biases (whatever they are) of the recommendation 
algorithm. In some sense, crowd avoidance could serve 
to quantify the bias of a recommendation algorithm (the 
bigger the improvement from using crowd avoidance, the 
more biased the algorithm). The accuracy improvements 
disappear if the bias of the recommendation algorithm is 
too weak or if it is coupled with true users preferences. 
One can for example choose a faction 1 — A of probe objects 
according to the bias given by the hidden variables {h a } 
and the remaining A fraction of probe objects at random. 
In this case, there is a limit value A* under which the accu- 
racy improvement disappears. To derive simple analytical 
conditions under which the diversification would become 
disadvantageous remains a challenge for future research. 

In systems where herding of users on an object reduces 
their benefits, crowd-avoidance can be applied to find a 
good compromise between satisfying the preferences of 
users and distributing them among objects evenly. We 
presently lack real data where some utility decline with 
occupancy can be expected. We thus studied artificially 
generated data and found an approximate solution for 
the object degree distribution as a function of the re- 
pulsion parameter. The mathematical formalization of a 
crow-avoiding recommendation establishes close connec- 
tions with different areas, such as optimization algorithms, 
spin glasses, and game theory, which could all contribute 
to future progress and insights. 

From the theoretical point of view, one can consider 
the case where user repulsion is replaced by attraction, 
possibly leading to a condensation phenomenon where a 
majority of users choose one object only (a similar situa- 
tion has been found in the preferential attachment model 
with heterogeneous fitness values [20]). The situation 
becomes more interesting when the deterministic utility 
maximization is replaced by probabilistic choice. (The 
most straightforward way to do that is to assume prob- 
ability of choosing an object with utility Ui a to be pro- 



portional to exp[/3iij Q ].) Various forms of user attraction 
can then manifest themselves in positive feedback mecha- 
nisms such as preferential attachment and its variants |211 
Ch. 14]. This effectively extends the fcrmion-boson range 
discussed here into a more complete one: fermion-boson- 
prcfcrcntial attachment. 
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